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Abstract 

> 
CO 

Qs, ' We obtain the full 5D graviton propagator in the Randall-Sundrum model 

O" 

with the Gauss-Bonnet interaction. From the decomposition of the graviton 
I propagator on the brane, we show that localization of gravity arises in the 

presence of the Gauss-Bonnet term. We also obtain the metric perturbation 
for observers on the brane with considering the brane bending and compute 
the amplitude of one massless graviton exchange. For the positive definite 
^ ' amplitude or no ghost states, the sign of the Gauss-Bonnet coefficient should 

be negative in our convention, which is compatible with string amplitude com- 
putations. In that case, the ghost-free condition is sufficient for obtaining the 
Newtonian gravity. For a vanishing Gauss-Bonnet coefficient, the brane bend- 
ing allows us to reproduce the correct graviton polarizations for the effective 
4D Einstein gravity. 
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I. INTRODUCTION 



The Randall-Sundrum(RS) [|l],^| model has drawn much attention recently because of 
several fascinating features related to the new attempt toward the hierarchy solution. The 
RS I model || is composed of two branes of the opposite tensions located at the orbifold fixed 
points in 5D non-factorizable geometry (or a slice of AdS^), which was proposed to explain 
the gauge hierarchy between the Planck and the electroweak scales. Here, the negative 
tension brane is considered as the visible brane. On the other hand, the RS II model PJ has 
a single brane with a positive tension in the 5D warped geometry (or a glued patch of two 
AdS$ spaces with a UV cutoff), where it is possible to get the localization of gravity on the 
brane even for non-compact extra dimension. 

However, the RS I model is cosmologically problematic for several reasons. Firstly, the 
Hubble parameter, H oc p 1 ^ 2 , in the early universe and the negative tension brane as the 
visible brane may be in conflict, since our universe would give rise to an imaginary Hubble 
parameter in a later cosmology at low temperatures ||. Second, there is no mechanism of 
radius stabilization in the RS I model itself [|J . Third, it is not obvious whether the universe 
with matter tends to the RS limit necessarily. For solving some of these problems, there 
was a proposal of radius stabilization with a bulk scalar coupled to branes and intro- 
duction of the Gauss-Bonnet term j7|. Also, there exists a proposal interpreting the positive 
tension brane as the visible brane and the negative tension brane as the intermediate scale 
brane || to obtain the /i-term in supergravity through nonrenormalizable superpotential H . 
In the last case, supersymmetry is necessary, which is redundant for a solution of the gauge 
hierarchy problem but maybe inevitable if some problems such as the unification of of the 
particle forces is required. 

For the RS II model 0, it has been shown that gravity is localized on the brane, which 
is shown by decomposing the full graviton propagator [|K],|Il|]. Here, a localized source 



induces a localized field, which diminishes as one goes toward the AdS horizon [10-12 



And, the brane bending effect in the existence of matter on the brane is shown to be crucial 
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for consistency of the linearized approximation [ITTJ and is necessary to reproduce the 4D 



Eintein gravity on the brane |IU , |IIf . Discussions related to the AdS/CFT correspondence 
in the RS II model also have been studied in the literature |I^, p!l| , p^ ,p!5Hl7| from which one 
can see that the RS II model is described by the visible matter gravitationally coupled to 
CFT with a cutoff. 

It is important to check the consistency of linearized gravity after the inclusion of the 
Gauss-Bonnet term which is called the Einstein-Gauss-Bonnet (EGB) theory. The Gauss- 
Bonnet term is a topological term in D = 4 [|l^,^] and it does not affect the graviton 



propagator even for the D > 4 flat spacetime background [Q. Since there are no higher 
order derivatives induced from variations of the Gauss-Bonnet term other than the second, it 
seems that there is no ghost problem in the low energy limit of the EGB theory. Therefore, 
it is reasonable to take the next leading curvature terms in the action as the Gauss-Bonnet 
term. For the RS II model in the EGB theory, it is shown that localization of gravity 
also arises around the RS type static background in view of the graviton mass spectrum 
0. The difference from the original RS II model is that it seems that the localized gravity 
appears on the negative tension brane for the static backgrounds allowed |Tj . In this paper, 
considering the full graviton propagator and the brane bending effect in the existence of the 
Gauss-Bonnet term, we show that excitation of ghost particles on the brane is a universal 
phenomenon in the low energy limit, regardless of our static solution backgrounds. This 
result is different from that in |[2Q|| , where it was shown that only one of static solutions 
could excite ghosts in the EGB theory. Several extensions of the EGB theory with a 5D 
dilaton field and the general higher order curvature terms were considered for discrete or 



smooth domain wall solutions in the subsequent papers |16tp2| -[24] . 

In this paper, we obtain the full 5D graviton propagator in the RS II model with the 
Gauss-Bonnet term and a manifest expression for localization of gravity which can be shown 
by the decomposition of the graviton propagator. Because the gauge choice of the metric 
perturbation is non-trivial with matter on the brane, the simplest gauge condition (the so- 
called Randall-Sundrum gauge condition ||) considered without matter is not valid any 



more. Nonetheless, in order to maintain the RS gauge even with matter on the brane, it 



has been shown that the brane is seen to be bent along the extra dimension [10,25,11,26 



Without the RS condition the gauge degrees of freedom are not completely removed, and in 
this case the introduction of the brane bending mode [|1(],[^,|11],^1J becomes crucial to choose 
the RS gauge and cancel the unphysical scalar degree of freedom of the tensor structure of 5D 
massless graviton. However, elimination of the scalar degree of freedom is incomplete in the 
existence of the Gauss-Bonnet term, and thus the 4D Einstein gravity should be modified by 
the residual scalar degree. In that case, the bending of light travelling near the Sun results 
in the different value as the factor ^1 — of that in the 4D Einstein gravity. (Here we 

notice that j3 is the dimensionless quantity given in terms of the Gauss-Bonnet coefficient 
and bulk cosmological constant as we will see later.) And we also investigate the stability 
of the static backgrounds from the amplitude of one massless graviton exchange and the 
Newtonian potential on the brane. As a result, the additional RS type solution is always 
unstable under perturbations because it excites ghosts giving rise to repulsive gravitational 
potentials between positive matter sources. On the other hand, for the static solution 
connected with the original RS solution, if the source relation is given as Sn + S22 7^ 0, 
the ghost-free condition requires that the sign of the Gauss-Bonnet coefficient (a) should be 



negative in our convention, which is consistent with string amplitude computations |31| , but 
otherwise it also allows the positive sign of a. And the condition of obtaining the Newtonian 
gravity is necessary for the ghost-free condition if Sn + S22 7^ O5 but otherwise just sufficient. 

In Sec. II, we present equations of motion of the EGB theory in the RS background. 
In Sees. Ill and IV we obtain Green's function and gravitational potential, respectively. In 
Sec. V solutions of the metric components are derived, and in Sec. VI we comment on the 
possibility of the light bending effect in the EGB theory. Sec. VII is a conclusion. 
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II. THE EINSTEIN-GAUSS-BONNET THEORY IN THE RANDALL-SUNDRUM 

BACKGROUND 



The RS metric of 5D warped spacetime consistent with the orbifold symmetry y — > —y 
0H is given by 

ds 2 = e~ 2k ^r]^dx^dx v + dy 2 (1) 
= g MN dx M dx N (2) 

where y is the fifth coordinate with y G (—00,00), of which just the half [0, 00) will be 
considered and k is the AdS curvature scale. Even with the Gauss-Bonnet term added in 
the 5D Einstein gravity (see Appendix A for the model setup), the static solutions are shown 

to have the same form as the RS metric, except the definition of k [J/J; 

1/2 



i±, i 4qAi 



3M 5 



(3) 



where M, a and are the 5D fundamental scale, the dimensionless parameter of the 
Gauss-Bonnet term and the bulk cosmological constant, respectively. 
Let us expand the EGB theory around the RS metric, 

9mn = 9mn + h<MN, (4) 

with the RS gauge condition [[|, 

^55 — h 5fl = 0, (Gaussian normal(GN) condition) (5) 

and 

= d^h^ = (4D transverse traceless(TT) condition). (6) 

Then we obtain the following linearized equations of motion for the case of a single brane 
without matter R, 



i 1 



+ 2k 2 (l - ^) - 2k (l - *g£) V(x, y) = 0. (7) 



The general higher curvature terms tend to give rise to the derealization of gravity |2T| , |23 
but investigation of the graviton mass spectrum of the above equation shows ]7[ that there 
is one bound state of massless graviton on the brane which is identified as the 4D graviton 
state, while the Kaluza-Klein modes give rise to small corrections to the Newtonian gravity 
for the length scale larger than the fundamental length scale. The fact that the localization 
of gravity is allowed in the EGB theory has been shown previously in [|21~l , p3f by integrating 



the action with respect to the extra dimension. In general, however, with or without the 
Gauss-Bonnet term, the metric does not satisfy the RS gauge condition on the brane with 
matter unless the matter energy-momentum tensor satisfies a specific condition, M = 0, as 
we will see later. Thus, it is necessary to start with the more general gauge other than the 



RS gauge |IT] , g7 , g8| , gT| or find out the metric junction condition on the brane by rewriting 
the Einstein's equations in terms of the extrinsic curvature tensor fL0| , p9| . 

There exists an ambiguity of gauge choice for the metric perturbation around the RS 
background. For the massless state in the Kaluza-Klein reduction of the RS model, the 5D 
TT condition, d M h MN = = h M M , leads us to be left with 5 degrees of freedom(DOF) of 
massless state after the residual gauge transformations, but with 6 DOFs without the trace 
free condition. The 5(6) DOFs are composed of two massless traceless symmetric tensor 
modes, two massless vector modes and one(two) massless scalar mode(s) in the 4D sense. 
Particularly, for the Gaussian normal condition, two vector modes and one scalar mode are 
decoupled while two tensor modes remain for 5D TT condition [Case (1)], and two tensor 
modes and one scalar mode remain for 5D transverse condition [Case (2)]. Case (1) does not 
satisfy the consistent boundary condition for the existence of matter on the brane, but it 
may do so if we make loose the GN condition to: = and h^{= —fify ^ 0. On the other 
hand, for Case (2), which can be shown to satisfy the boundary condition with matter on 
the brane, there exists an additional unphysical scalar degree of freedom, which is shown to 
be cancelled by the fifth coordinate transformation (brane bending) maintaining the metric 
as a GN form |ggB . 



When we choose just the Gaussian normal condition without the 4D transverse traceless 



condition, the linearized equations of motion for h^ v and h = with matter on the brane 
are given as follows (see Appendix A for the details), 



4ak 2 I 8ak , 



1 I 1 <±(jui- 
— -1.1. MT + UI^tf / i-A- 2 



ll l-^)d 2 + ^sgn(y)d(y)d y 



+ 2k 2 1 



4afc 2 
M 2 



— 2jfe 1 



12afc i 

M 2 



+ i 1- 



Aak 2 
M 2 



+ ^5(y))e 2k \y\(2d { ,d x h u)x - d&h - ^ u d x d p h x P) = M~% 



/IV 1 



(8) 



(9) 



where 



1 - 



Aak' 



Y l) (R^-\g^R) =m- 3 t 55 , 



(10) 



T^v = S pu (x)5(y) 
1 



5/j 



(11) 
(12) 



5 (1) (i?55 - \g&>R) = -\e Ak ^d^{h^-r,, u h) - hsgn(y)d y (e 2k ^h). (13) 

Here, 5^ denotes the linear perturbation. If we take the trace on both sides of the (/xz/)- 
component of Eq. (Q) and use the (55)-component of Eq. (|TUp, we obtain the equation of 
motion for the region y > and the boundary condition at y = for h as follows, 



On 



e~ 2ky d y {e 2ky h) 



-i 



- 2k yd y (e 2k yh)\ y=+0 = |m- 3 (i - ^) 



-i 



T 55 (0) 



(14) 
(15) 



The /i equation can be rewritten by using the conservation of T, i.e. y M T M5 = (where y 
denotes the action on the background), 



7) 



55 



■—M~ 
3k 



4a k 



2\ -1 



0%5- (16) 
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III. GREEN'S FUNCTION 



^From Eq. (14) or Eq. fllTf ), if ^ or d^T^ ^ 0, the trace h has the exponentially 



growing component, in which case the linear approximation breaks down. So, to cancel the 
growing component, let us consider a deformation of coordinates maintaining the metric as 
a Gaussian normal form [ |TCi| , f2l)| ,|il"|j ; 

x '» = x fM - y) 

= x" + \e 2ky ^ x d x ^{x) - £»(x), (17) 

such that 

ds 2 = g^(x, y)dx^dx v + dy 2 = g'(x', y')dx'^dx' v + dy' 2 . (18) 

Then, the metric perturbation transforms as 

hp,{x,y) - h'^{x,y) = h, u (x,y) - ^d^x) + e'^d^x) - 2k£ 5 (x)ri ta ,]. (19) 

When we integrate both sides of the Eq. ([16]) with respect to y with the initial condition at 
y — 0, Eq. (|T5D, we have the exponentially growing component of h eliminated by the gauge 
choice with 



S^x) 1 (\-\2ak 2 jM 2 \ 1 p 



fc V 1 - Aak 2 /M 2 



(20) 



where y m denotes the range of the matter distribution along the y coordinate. For the matter 
localized on the brane, we have the solution for £ 5 as 

e(x) = l -M-* ( 1 - 1 [ d*x'G A (x, *')S A V) (21) 



6 V M 2 

where G^(x, x') is Green's function for the massless scalar in the 4D Minkowski space. Then, 
in the primed coordinate, integrating Eq. (|l^) with respect to y, we obtain 
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d y (e 2ky ti) = -4m" 3 1- 



3k 



4a k 



2\ -1 r 



Tsb(v) - e 



dyd^T, 



On the other hand, we obtain the (5/z)-component in the primed coordinate from Eq. 



d y {e 2ky d x h') = dy^dji') + 2M- 3 ( 1 - 



Then, with the definition of the following metric, 



from Eq. (^3|) and Eq. Q2"^), we always have 



Aak^- 1 



M 2 



(22) 



(23) 



(24) 



d y (e 2hy d% x ) 



0. for y > y m . 



(25) 



[Note that matter does not exist beyond y m and T 55 (y > y m ) = 0.] Moreover, we can 
obtain the de Donder gauge condition d x h'^ x = just outside the matter distribution by the 
remaining gauge invariance £ M and the same for y > y m using Eq. (|25|) . Therefore, when 
there exists the matter source only on the brane (i.e, T 5fl = T 55 = 0), we can always choose 
the 4D transverse traceless gauge d x h' pX — h! — both in the bulk and on the brane. 

By the way, the boundary condition of the (/iz/)-component on the brane is given from 
the Eq. (^) as follows, 



(d y + 2k) + ^e^d 2 (V - ?7»ly=+o 



- ^e 2k y(2d ( ,d x K )x - d,d v h - ^9 A 9 p ^)| y=+ o 



(26) 



Then, with the metric hu U , we can rewrite the above boundary condition as follows, 



1 



12ak 2 



-yp- j (d y + 2k) [h^ + \r] pv h j \,,._. „ 
+ ^e 2k y{d 2 x h, v - d,d x h uX - d u d x h, x + ^d x dPh Xp )\ y =+o = -m-*s, 



fj.ii 



(27) 



which becomes in terms of h[ 



flVI 



^)( dy + 2k)[h^ + ± Vlxu h')\ y=+0 
+ ^e 2k y(d 2 h'^ - d,d x Kx ~ dud% x + v,ud x d"h' Xp )\ y=+0 



-M~ 3 S 



2 1- 



iak 2 



(28) 
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When d^h'^ u — = h' [Note the definitions given in Eqs. ([19]) and (0).] is chosen on the 
brane by the gauge shift of we obtain the boundary condition in the primed coordinate, 



= -M" 3 ^ - 2 ( 1 - (d,d u - V ,»dl)e. (29) 



Then, by using the Eq. (|2~1|), it is shown that the trace of the above equation is consistent 
with the traceless condition h' = 0. Note that the transverse condition d^h' = implies 
the conservation of the 4D energy-momentum tensor: d^S^ v = 0. 

Consequently, considering the Eq. (0) in the RS gauge for the case without matter on 
the brane, the linearized equations of motion for the brane with matter becomes in the RS 
gauge, 



1 - ^ + ^{y))dle^y\ + (l - - l ^sgn{y)8{y)d y 

4fc 2 (l - + 4k(l - l ^£)8{y)\h>» v {x,y) = -2M-%„ (*)<%), (30) 



where 

£ M „ = S, v + 2M 3 (l - ^) {d,d v - rj^dDe. (31) 

Therefore, in the RS gauge for which the brane is located at y — — £ 5 (x), we can obtain the 
metric perturbation in terms of the graviton propagator as 



/roc 
d 4 x'J o dy'G h (x,y-x',y')Y:^{x')8(y') 

= -M- 3 J <?x'Gs{x,y-x',U)Y Illv (x') 



M- 3 / d*x'G 5 (x,y;x',Q) S, v {x') - \^S x x {x') + \^S x x {x') 



(32) 

where Eq. (|2T|) is used in the last line and we note that the graviton propagator is well 
defined for either side of the brane, i.e. valid for the half of the bulk space y > and the 
other half by the Z2 symmetry. However, the metric h' v is not appropriate for observers on 
the brane since the brane becomes bent as y — — £, 5 (x) in the RS gauge. Nonetheless, there 
exists a simpler gauge for observers on the brane in which case the brane is located at y — 
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as before the coordinate transformation. It will be shown in Sec. V. Then, the equation of 
motion for the graviton propagator is given by 

"(l - ^ + 8 !$5(y))dy ky + (l - A -w)d 2 y ~ 1J §£sgn(y)6(y)d y 
- Ak 2 (l - ^) + 4*(l - ^)«y(y)]G 5 (x, y; x', y') = 5( 4 )(x - x')<% - y'). (33) 

Now we can decompose the graviton propagator into Fourier modes as 

G 5 (x, y; x', y') = J -^^^G p (y, y'), (34) 

and the equation of motion for the Fourier mode G p (y,y') is given by 

1 - # + f§<%)Ve 2 ^ + (l - - ^f S gn(y)5(y)d y 



-Ak 2 (l-^)+Ak(l-^f)8{y) 



G p (y,y') =%-</). (35) 



IV. GRAVITATIONAL POTENTIAL 

By a change of variable z = the following equation of motion and the boundary 
condition are satisfied by the propagator, 

(zc> 2 + 2 - /3pV)G p (z, ^)U=i/fe = (37) 

where 

8 = 4ak2/M2 rssi 

The solution for the graviton propagator is composed of the Bessel functions of order 2, 
(J 2 (g/fc) and Y 2 (q/k), q 2 = —p 2 ) and it must satisfy Eq. (|TF|) and the boundary conditions 

at z = z , 

C<| z=z ' = G>| z=2 /, (39) 
/ 4afc 2 \~ 1 1 

*< G > " G <)i— - -w) i? < 40 > 
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where > (<) indicates z larger (lesser) than z' . 

For z < z r , taking into account the Eq. (pT|), we have 



Y 1 (q/k) + ^Y 2 ( q /k)y 2 (qz) - (j^q/k) + ^ J 2 {q/ k^qz) 
Ji(q/k) + ^Hq/k^H^iqz) - (H?\q/k) + ^H { } ] (q/kf) J 2 {qz) 



G < (z,z') = A(z') 
= zA(z> 

where — + ^1,2 is the first Hankel function. On the other hand, let us turn to the 
range of z > z'. Requiring that positive frequency gravitational waves be ingoing into the 
AdS horizon |[L1|| , which implies that there is no radiation reemitted from the AdS horizon, 
we also obtain 



(41) 



G > (z,z') = B(z')Hi 1 \qz) 



(42) 



^From the matching conditions Eq. 
momentum space as follows, 

4ak 2 ^ - 1 



and Eq. fl40|), we get the graviton propagator in 



G p {z,z') 



M 2 

Mqz^H^iqz^ 



m 
2k 



J^q/^ + fJijq/k) 
H?{q/k) + ^\q/k) 



H^iqz^H^iqz^ 



(43) 



Then, for the source on the brane, i.e., z' = -r, the graviton propagator in coordinate space 



is given by 



G 5 (x, z\x 



, 1 



4ak 



2\ -1 



J2n) 4 



D ip(x—x') 



■nl 



H?\qz) 



H?{q/k) + ^H^{q/k) 



(44) 



Furthermore, using the Bessel recursion relation H' 2 \q/k) = ^■H K i > (q/k) — H^^q/k), we 
have the graviton propagator on the brane decomposed into two terms, corresponding to 
the massless mode and the Kaluza-Klein(KK) states, respectively, 



2k tt(1), 



r(i), 



G 5 (x, -;x', - 



1 - 



4ak 
TP 



2\ -1 



2k 



1 + 2/5 



G^x, x') 



+ G KK (x,x'), 



(45) 



where 
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G 4 (x,x')= I -^e^-*') 1 



(2tt)< 



G 



4ak 



2\ - 1 



(46) 



kk{%, x 



1 



M 2 J VI + 2/5 



d 4 P j P (x-x') . 



(27T) 



H^\q/k)-{0)H^\ q /k) 



(47) 



That is, from the above decomposition of the graviton propagator, we confirm the localiza- 
tion of gravity on the brane even in the existence of the Gauss-Bonnet term, irrespective of 
the static solution backgrounds. However, since there appears the non-trivial factor in front 
of the 4D Minkowski Green function, we should be careful with the ghost-like behavior of 
the resultant Newtonian potential, which will be dealed with later. And, we can see that 
the Gauss-Bonnet term affects both massless graviton and KK graviton propagators unlike 



the case in the flat background spacetime [18 



^From the exact form of graviton propagator we found above, let us consider the asymp- 
totics of the graviton propagator for a static source on the brane. At large distances 
r = \x — x'\ ^> k^ 1 or low energies p/k <C 1, the graviton propagator on the brane has 
the following limiting behavior, 



V{r) 



dtG 5 (x, y;x', t 
k k 

! 4ak 2 



d 3 P ip(x-x') 



M 2 J J (2tt) 3 
4afc 2 \- 1 k 



2k 



+ 



M 2 



2nr 



1 + 2(3 



1 + 2(3 J p 2 VI + 2(3 J k 
1 \ 2 1 



ln{p/2k) 



(4* 



1 + 2(3) 2(kry 



We note that the above static limit of the graviton propagator is very similar to the result of 
Ref. Nonetheless, the nontrivial factor (1 + 2/3) -1 as well as the overall factor (1 — ^r) -1 
in front of the Newton potential, 1/r, show the crucial point such as the ghost-like behavior 
in the existence of the Gauss-Bonnet term. However, even if the equation of the graviton 
propagator does not allow the mode sum in our case because of the non-hermitianity of the 
differential operator, we may regard the graviton propagator as the sum of massless mode 
and massive KK modes just as in the RS case 0. 
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On the other hand, for z ^> k 1 and/or r = \x — x'\ ^> k , another static limit of the 
graviton propagator off the brane is given by 

V(r,z) = JdtG 5 (x,z;x',^) (49) 

-d - 4afc VY 1 ^ 3 1 1 + g f5D 



1 + 



As a result, the metric perturbation falls off as h ~ -3 (for z 3> r), which ensures that the 
perturbative expansion is valid towards the AdS horizon [jO] . And, a localized gravitational 
source produces a localized field, not strong at the horizon. 

V. SOLUTIONS FOR THE METRIC COMPONENTS 

To find solutions of the initial metric perturbation h^, by using the additional freedom 
£fj,(x) in the inverse transformation of the metric in Eq. ([19]) to set 

we can have a simple expression for the metric perturbation on the brane at z = \ whose 
4D hypersurface is perpendicular to the AdS horizon, 

hr{x) = hP{x)+h${x) (53) 

where ^ denotes the matter contribution and ^ denotes the brane bending effect, 

h^\x) = — M~ 3 J d 4 x'G 5 (x, ~; x', i) (s^tf) - 7^S A V)) (54) 
h$(x)=2kri (lu e(x)- (55) 

The second term of the metric perturbation h$l in Eq. ([53]) is due to the brane bending 
T~0| , |25|JTl] , |26[1 , which is a scalar mode on the brane coming from the trace part of matter 



energy-momentum tensor in Eq. (PH). We can rewrite Eq. (|5B|) by using Eq. fl4"5] ) and 
Eq. ( ]2~T1) as follows, 
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h, v (x) = -Mp 2 J dVG 4 (z,x')[<V(z') - (- + -f3)v»vS x x (x') 
- M~ 3 J d 4 x'G KK (x,x') S^ u (x) - -rj^Sxix') 



(56) 



where brane bending effect contributes only to the trace part. The effective 4D Planck scale 
Mp in the limit of vanishing (3 or a could be identified as 



M 3 



Aak 2 ^ 2 



1 + 2(3) 
1 



167rG7v 
12ak 2 ^ - 1 



(57) 



2k V M 2 / V M 2 
From the above expression for the metric perturbation, we can see that as (3 — > or a — > 0, 
the brane bending effect yields the usual factor | [fTQ| , |26[1 of the trace part of the 4D graviton 
propagator, but otherwise the 4D Einstein gravity could be modified by the additional 
polarization factor ^f3. The case for the bending of light will be treated in Sec. VI. 

Let us consider the amplitude for one massless graviton exchange in the presence of 
the source P7PB| . In momentum space, it is given from the first part of the metric 
perturbation Eq. (|5*E| ) as follows, 

1 



^massless —fi S^ U 

AttG n 



p- 



3^-(± + i/3)(£*) a 



(58) 



If we take a Lorentz frame in which p M is given as a null vector such as 



p° = p 3 , p 1 = p 2 = 0, 



we obtain the following source relations, from the transverse condition, d^S^ v = 0, 



(59) 



&00 — ^03 — <->33j <->01 — ^13) >->02 — 



2.3 ■ 



(60) 



Therefore, we obtain the amplitude as 

AttG n 



massless 



-pi + pi 



■ S +2| 2 + |5'-2| 2 — — + 5*22)^ 



(61) 



where the first two terms are due to the exchange of massless spin-2 graviton, S±2 = 
h(Sn — S22) ± iS\2, and the third term comes from the residual massless graviscalar. To 
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obtain a positive definite amplitude, the conditions, Gn > and /3 < 0, should be satisfied 
simultaneously. 

For the k + solution, the amplitude is always negative since Gn < so that ghost states 
could be excited near the background. That is, it means that the k + solution is unstable 
under perturbations and therefore we have to exclude it at the perturbative level. 

On the other hand, for the solution, if Sn + S22 7^ 0, there should be a bound on 
the bulk parameters such as — | < (3 < (equivalently, a < 0) in order to have only the 
positive norm states. Therefore, the allowed sign of a, i.e., a < is compatible with string 
tree amplitude computations |3l|. If we require that Sn + S22 = 0, the bound on the bulk 



parameters becomes (3 > — ~; —(5/9) < < for a > and any value for a < 0. 

By the way, because the tensor structure of the metric perturbation will be modified, 
the above identification of the effective 4D Planck scale should appear a little different. For 
instance, in case of a static point source with mass m on the brane, i.e., for the energy- 
momentum tensor S^ v = m5^o5 U Q5^{x), components of the metric perturbation due to the 



matter and the brane bending mode are given by, in accord with Eq. 



and Eq. 



M' A mV{r 

3 



M^mV^Sij, 
4ak 2 \- 1 M- 3 m 



1 



M 2 



247rr 



(62) 
(63) 
(64) 



where V(r) is the same as given in Eq. (|48| ) and i, j run from 1 to 3. Therefore, we obtain 
the approximate metric perturbation in the unprimed coordinate for a static point source 
on the brane as the following, 



/loo 0*0 



hij (**0 



r 

2(5 Arm 
r 

2G jyTTT, 

r 



2 2/ 1 \ 2 1 
3^ + 3U + 2/5j (fcr) 2 



1 + 



1 + P 



LU-f/3 

where by the Newton potential - 



in 



1 + 2(3 ) (jfcr) 2 
1 



2 

-J 



1 + 2(3/ (kr) 2 



(65) 
(66) 
(67) 



— I /ioo, the Newton constant is identified as 
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Gn = 



k ^ak 2 \- x (I- IP 



8ttM 3 V M 2 ) \ 1 + 2(3 
1 



167TMJ, ' 



(68) 



where the correct effective 4D Planck scale Mp is given by 



M 3 ( 4ak 2 \ 2 f 44afc 2 \- 1 , . 

1-^75- • ( 69 ) 



2k \ M 2 J \ 3M 2 
In the Eq. (pop, the first term of - potential stems from the spin-2 graviton while the second 
term does from the residual graviscalar. But, since the two contributions are of the same 
behavior as -, we should identify the Newton constant from the sum of the two as in Eq. flBBp. 

For the k + solution {k = k + in Eq. (|68l)), the Newton constant Gn would be negative 
and 1 — |/3 > always, which might give rise to repulsive forces of massless and massive 
gravitons. That is, the k + solution would give rise to the anti-gravity so that it is shown 
not to be allowed under perturbations again. 

The instability of the k + solution can be shown from the weak energy condition on the 



background matter: T^ N ^ M ^ N > for any null vector £ M p0| , p8| . We assume that the 



background matter T^ N localized on the brane (i.e., T 5 g = T$ = 0) produces the metric 
with 4D Poincare invariance as follows, 

ds 2 = gMN<ix M dx N 

= e- 2a(y \ iiV dx ii dx v + dy 2 . (70) 

^From the weak energy condition and the modified Einstein's equation, T^' N = M 3 (Gmn + 
Hmn) + ^-bfjAiN, we have the following non-negative condition for the background metric 



(compare with the result given in Ref. p3 |) 



-"(1-^1 >0. (71) 



M 2 

Therefore, for a" > for the localization of gravity as in the RS case, we have the condition 

M 2 



1 — Aai C,2 = =F\/l + (4aA 6 /3M 5 ) > 0, for the k± solutions, respectively. Therefore, the k. 



solution is the only 4D flat solution allowed with localized gravity that satisfies the weak 
energy condition. On the other hand, the k + solution violates the weak energy condition for 
localized gravity. 

On the other hand, for the k- solution, the attractive normal gravitational potential is 
allowed for the range of a as —0.47 < < for a > and any value for a < 0. Therefore, 
even the k_ solution could give rise to a repulsive force in some bulk parameter space with 
a > even though the weak energy condition is satisfied. Recalling that there is a lower 
bound in the allowed static solution space itself such as — 1 < < for a > for the k- 
solution, we see that the Gauss-Bonnet interaction should be weaker than the bound given 
in Ref. |7| to avoid the anti-gravity by about the half. However, from the consistency for no 
ghost states in case of Su + S 2 2 ^ 0, the sign of a should be negative. And, if Sn + S 22 = 0, 
the ghost-free condition is just necessary for the attractive gravity. 



VI. BENDING OF LIGHT AND MORE ON THE LOCALIZATION PROBLEM 

We can also show that the bending of light passing by the Sun could be modified with the 
Gauss-Bonnet term. For a source in the xz plane on the brane, the bending of light travelling 
in the z direction is described by a Newton-like force law, 'x = |(/ioo + h zz ) tX . Note that 
corrections to h 00 and h zz are different [viz. Eqs. (|66| ) and (|67D], which modifies the bending 
of light. If the metric perturbations due to the Sun are approximated by those from a point 



-i 



source, the bending of light is ( 1 — ~/3 ) of that predicted from the 4D Einstein gravity. 



Therefore, since the maximum deflection angle of light is given as 58 max = (0.95 ±0.11)1.75" 



from the experimental measurements [0, we can get another bound on the Gauss-Bonnet 
coefficient as —0.20 < < 1.2 for the static background connected to the RS solution. 
As a result, we can see that the ghost bound is compatible with the experimental bound 
from the bending of light. 



Now let us make some comments on quasi- localized gravity theories [33] with the Gauss 



Bonnet term. In the quasi-localized gravity, the linearized 4D Newtonian gravity can be 
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reproduced at the intermediate scale up to some correction proportional to the decay width 
of metastable graviton while the 5D Einstein gravity remains itself both at the short and 



large distances [33|. But, because the 4D Newtonian gravity is reproduced by the massive 5D 
graviton, the unwanted polarizations in the tensor structure of the 5D graviton propagator 
cannot give rise to the correct 4D Einstein gravity p|] and even if the brane bending effect 



cancels the extra polarization at the intermediate scale [pq] , it gives rise to the scalar anti 



gravity at the ultra-large distances [p5| . For our case with the Gauss-Bonnet interaction, 



we cannot escape such a ghost problem [^,[3g,^7],^|] . That is, the gravitational potential 



corresponding to the brane bending mode gives a repulsive force even with the Gauss-Bonnet 
term as follows, 

^)=/*f-ifcSM) = ^fi-^r. (72) 



2 uu v V 247rr V M 2 

Even though the scalar potential could be attractive for the k + solution, there should exist 
the more severe ghost problem in the 4D graviton sector as already discussed in the previous 
section and moreover the weak energy condition of Eq. ( |7T| ) would be violated. So we argue 
that there still appears the scalar anti-gravity in quasi-localized gravity even with the Gauss- 
Bonnet interaction. 



VII. CONCLUSION 

In conclusion, we obtained the full 5D graviton propagator in the Einstein-Gauss-Bonnet 
theory with the Randall- Sundrum background. From the decomposition of the graviton 
propagator on the brane, we confirmed the localized gravity in the Einstein-Gauss-Bonnet 
theory. The brane bending effect, even if it is crucial to reproduce the right 4D Einstein 
gravity in the RS model, does not cancel the extra polarization of the tensor structure of 5D 
massless graviton completely for the case with the Gauss-Bonnet term. As a result, we can 
have the bound on the Gauss-Bonnet coefficient from relativistic effects such as the bending 
of light. And furthermore, if Sn + S^ 7^ 0, the ghost-free condition from the amplitude of one 
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graviton exchange requires a < 0, which is compatible with string amplitude computations. 
If S11 + S22 7^ 0, the ghost-free condition is sufficient for giving the correct Newtonian gravity. 
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APPENDIX A: METRIC EXPANSIONS WITH THE GAUSS-BONNET TERM 



When the Gauss-Bonnet curvature squared interaction is added as the additional effective 
interaction to the Einstein-Hilbert term in the RS II model, the 5D action is given by the 
following, 

S = S + S m (Al) 

S = J d n x^g ~ A b + ^aMR 2 - 2aMR MN R MN + ^aMR MNPQ R MNPQ ^j 

+ J d 4 xdy5(y)^f^)(-A), (A2) 
S m = J d b x^C m (A3) 

where g,g^ are the determinants of the metrics in the bulk and the brane, M is the five 
dimensional gravitational constant, A& and A are the bulk and brane cosmological constants, 
a is the effective coupling, and C m is the matter Lagrangian on the brane or in the bulk. 
Equations of motion in this EGB theory are, 

G MN + H MN = M' 3 {-A b g MN + T MN ) (A4) 



where 



Gain = Rain — ~9mnR, (A5) 



FT ~ a 



-Qmn{R 2 — AR PQ + RpqstR PQST ) 



+ 2RR MN — AR MP R N p — AR K mpnRk F + 2RmqspRn P 



(A6) 



rp _ rp(0) i rp(m) , a 7 \ 

-lain = -i mn + 1 mni 

T (o) M n = ^E^5{y) diag{-A, -A, -A, -A, 0), (A8) 



T (m) = 2 2zm ( AQ) 

2 MN- CIg-SgMN- 



For the background metric Eq. Q70|), the nonvanishing components of the Riemann tensor 
and related things are given by 
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RpvXp 


/ /\2 / — — — — \ 

-\<r) {9iiX9up- 9n P 9u\), 


/ A -1 r\ \ 

(A10) 




/ // / /\2\ — 

[a -{a) )g llv , 


(All) 


RfXU 


(a" - A(a'f)hu, 


(A12) 


R55 — 




(A13) 


R = 


8a" - 20(a') 2 . 


(A14) 



Then, considering the metric fluctuation around the RS background Eq. (|70|) such as g m n 
9mn + h>MN, from the general formulae for linearizing the curvature tensors, 



W..\ — — -V 2 ^MAf — RMPNQh PQ + R(M P hN)P + V (AfV^ ' ^N)P ~ ^ VmVaT^-P ? (A15) 

= -iW/> MJV - V V p + VuV N h MN (A16) 

'|Af|' 4 iV] ~ V[PV ' l JV]AT> 

we get the following linear expansions with the Gaussian normal condition, = /155 = 0; 



5V>R 



5^R K mpn = Q pN ^ M Q — R Q mpn^q K ) + V[pV|m|^-at] K — \/[p\/ K hN\M- i A 17 j 



§Wr 55 = e 2r7 ( - -d 2 h - a'd 5 h - a"h 



SWr = e 2a (e 2(7 d p d u h^ - g PQ d P d Q h + a'd 5 h + {-2a" + 6(a') 2 )h 

and 



(A18) 
(A19) 
(A20) 
(A21) 



= 2 (^ A Q - # Q A + VpVA A ~ v*vA A - v P v A V + v^v^. 



PP/ 1 



e^(d p d^K A - dpdvhp A ) + g^i-dpd.h^ + V) 



+ v'i-Vpu.d'sK + r] pu d 5 h p + g p d 5 h pu - g u d 5 h pp ) + 2(a') {-i] pp h u +r] pv h 



5 (1) ^% 5 , = t;(R 5 Q 5uh p Q - R Q p5u h Q 5 + VsVA 5 - V.VA 5 - Vs V + V„V M 



-<9 2 V, ~ cr'd^h^ - (a') 2 h pu 



(A22) 



(A23) 



5«it! A 



5p5 = ^ QP5^5 Q - i? Q 5p5 /iQ A + Vp Vs^S A - Vs^P A - Vp V ^55 + V 5 V M 
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= e 



2a 



-B 2 h x 

2 °5 tl P 



o'd h h x -o"h x 



1 

2 ( 



S^R 5 



55u 



S^R 5 



e 2 °{d p h v x -d u h p x ) 
0. 



555 



(A24) 
(A25) 
(A26) 



The general formulae for the higher curvature terms are, 

5 (1 \R 2 ) = 2R5 {l) R 
5^(R MN R MN ) = 2R P ^R PQ - 2h PM R PQ R M « 
^ 1 \RmnpqR MNPQ ) = g MT ^ 1 \RmnpqRt NPQ ) — h MT RmnpqRt NPQ 
5 {1) (RRmn) = Rmn 5 {1) R + R 5 {1) R MN 
^(RmpRn P ) = Rm P 5^R NP + R N p 5^R M p — h PQ R mp R N q 
5^(R K MPN R K P ) = R K P 5^R K MPN + R K m P n S^Rkp — h PQ R K mpnRkq 



(A27) 
(A28) 
(A29) 
(A30) 
(A31) 
(A32) 



{RmqspRn qsp ) = R s p m Q S^R S P nq + R,s P n Q S^R S P mq — h QT RsfmqR SP NT- (A33) 

Then, imposing the Gaussian normal condition only, /i 55 = h 5p = 0, linear expansions of the 
Einstein tensor Gmn, the higher curvature tensor H MN and the energy- momentum tensor 
T MN are given by, 

1 



5 {1) G pv = -tfQ dpdQ{Ky _ %vh ) + (_ 4(7 " + 8 (a') 2 ) V 
+ h 2 °(2d { ,d x h v)x - d„d v h - r)vvd x d p h x »), 



{a" -2{a') 2 )r ] , v h 



S^G 



5fj, 



-A, 



e 2 °{d x h» x -d,h) 



S (1) G 55 = - l -e A °d»d»{h» v -n^h) - \a'd y {e 2 °h), 



(A34) 
(A35) 
(A36) 



and 



S^H = — 

M 2 



(_ 2(7 " + 2(a') 2 )g x ?d x d p + 2{a') 2 d 2 y + Aa'Wd y j {h pv 
+ (24a"(a>) 2 - 20K) 4 ) V + (-I2a"(a') 2 + 8(</) 4 )^/i 
+ {2a" - 2{a') 2 )e 2 °{2d {p d x h u)x - d p d u h - ^d.d^) 



5/i 



4a{a') 2 
M 2 



5 {1) G 5 ,, 



(A37) 
(A38) 
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and 
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4a (Q 
M 2 



A 2 



(A39) 



5 (1) T^, = (— A 6 - AS(y))h tlv + 

2a(a') 2 



Q(a'Y 1- 



M 2 



-3a" 1- 



4a(<7 / ) 2 
M 2 



5 {1) T 5 , 
5 (1) T 55 



(m) 



5/J 5 

p(m) 
-55 ) 



7 , j,( m ) 



(A40) 
(A41) 
(A42) 



where we expressed the bulk and brane cosmological constants in terms of the background 
metric function a. Consequently, from the modified Einstein's equations, Gmn + H MN = 
M~ 3 Tmn, the linearized equations of motion become, 



1/ Aa(a') 2 Aaa"\ 
2 V M 2 M 2 ) 

+2{a') 2 [l- 



V 1 '- '( 



4a(cr 



A2 



M 2 



c 1 — 



( V _ V fusty 



ln{<T ' ' 2 + ^C)e 2rT (2d ( ,d x K )x - fy&Zi - v^dxd^) = M- s Tj£\ (A43) 



M 2 



M 2 



4a(<7 / ) 2 

M 2 
4a(q') 2 

M 2 



)5«g 5m = m- 3 t 5 ( ; ) , 

5 (1) G 55 



M" 3 T 5 ( 5 m) . 



(A44) 
(A45) 



Apart from terms including a", which corresponds to the delta function source, the linearized 
Einstein's equation remains intact up to the overall factor ^1 — ^ on its left hand side 
even in the existence of the Gauss-Bonnet term. But the overall factor is not a positive 
definite quantity, which implies that a test particle might feel a repulsive force (or exchange 
of ghost particles of negative energy) from arbitrary matter source. 
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